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Control-theoretic modeling of the human operator dynamic behavior in manual control 
tasks has a long and rich history. In the last two decades, there has been a renewed interest 
in modeling the human operator. There has also been significant work on techniques used to 
identify the pilot model of a given structure. The purpose of this research is to attempt to go 
beyond pilot identification based on collected experimental data and to develop a predictor 
of pilot behavior. An experiment was conducted to quantify the effects of changing aircraft 
dynamics on an operator’s ability to track a signal in order to eventually model a pilot 
adapting to changing aircraft dynamics. A gradient descent estimator and a least squares 
estimator with exponential forgetting used these data to predict pilot stick input. The results 
indicate that individual pilot characteristics and vehicle dynamics did not affect the accuracy 
of either estimator method to estimate pilot stick input. These methods also were able to 
predict pilot stick input during changing aircraft dynamics and they may have the capability 
to detect a change in a subject due to workload, engagement, etc., or the effects of changes in 
vehicle dynamics on the pilot. 
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Nomenclature 

amplitude 

mean of the absolute difference between Stick and Stick_hat 

non-parametric uncertainty in the system 
phase angle (rad) 

Pitch - Pitch cmd 

regressor vector of Radial Basis Functions 

unknown parameter vector in model estimation 
damping ratio 
time delay (ms) 
gain 

zero location 

vehicle pitch (deg) 

commanded vehicle pitch (deg) 

estimated stick position ([-1:1]) 

pitch attitude tracking command (deg) 

pilot stick 

pitch attitude 

short period frequency (Hz) 
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I. Introduction 

C ontrol-theoretic modeling of the human operator dynamic behavior in manual control tasks has a long and rich 
history 1, 2 . A great deal of foundational work in understanding the human as a controller was done in the 1960’s 
and 1970’s with the development of frequency-domain based models for single-input/single-output systems by 
McRuer 3,4 . The frequency-domain models included isomorphic structural models and behavioral based models. The 
classical McRuer crossover model of compensatory manual control is still used as a standard for describing the 
operator-vehicle behavior at the crossover frequency 4 . In essence, the model states that the human operator will 
adapt to vehicle dynamics by providing lead equalization, with an associated computational penalty, such that the 
combined operator-vehicle transfer function is proportional to an integrator at the crossover frequency. Another 
approach to understanding the human-as-the-controller behavior was the development of the optimal control model 
by Kleinman, Baron, and Levinson based on the assumption that a well-trained and motivated human controller 
behaves optimally in some sense, adjusting the pilot's compensation for a given vehicle and task, subject to human 
limitations 5 . 

In the last two decades, there has been a renewed interest in modeling the human operator. Further model 
development by Hess in the frequency domain, a structural model 6 , and Schmidt in the time domain, a modified 
optimal control pilot model 7, 8 , attempted to take into consideration appropriate relevant feedback that influenced a 
pilot’s behavior such as proprioceptive cues, and visual and vestibular feedback. While these models proved useful, 
their application to realistic simulation tasks involved a great deal of complexity. In an attempt to simplify the 
model while still capturing the essential pilot behavioral characteristics, Hess proposed a simplified model that has 
been recently applied to systems with time-varying dynamics 9, 10 . 

In addition, to several relevant model structures to describe the pilot as a controller behavior, there has also been 
significant work on techniques used to identify the pilot model of a given structure 11 " 17 . These included various 
applications of parameter identification ranging from wavelets-based approach to frequency-based system 
identification techniques. 

The purpose of this research is to attempt to go beyond pilot identification based on collected experimental data 
and to develop a predictor of short-term pilot control behavior. An experiment was conducted to quantify the effects 
of changing aircraft dynamics on an operator’s ability to track a signal in order to eventually model a pilot adapting 
to changing aircraft dynamics. 


II. Procedure 

The experiment on changing aircraft dynamics is briefly summarized below. The proposed approach to pilot 
behavior estimator is described and two different estimation algorithms that have been applied to the problem are 
presented. 


A. Pitch Dynamics 

This research used data from an experiment that looked at short period dynamics. See Ref. 18 for a detailed 
description. In that experiment, longitudinal dynamics were controlled while lateral/directional and thrust values 
were held constant at a heading of 40 deg and a speed of 300 kts. The altitude at the beginning of each data run was 
10,000 ft. The aircraft short-period pitch attitude transfer function was: 
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Table 1. Aircraft short-period 
attitude parameter values. 


pitch 


where 6 is pitch attitude and is pilot stick. The aircraft’s short- 
period pitch attitude parameters and their associated values are 
listed in Table 1. 

1. Tracking Signal 

The maneuver was designed as a 30 sec longitudinal tracking 
task. During the 30 sec, subjects tracked the longitudinal signal 
as closely as possible using a standard electronic attitude 
indicator. The tracking command input contained a range of 
frequencies and amplitudes to excite an appropriate dynamic 
range. 

The longitudinal tracking task was designed to contain a variety of discrete frequencies in the frequency range 
associated with human pilot inputs, namely 0.1 to 10 rad/sec. The input design method is described in detail by 


Parameter 

Values 

Gain ( K) 

1,2,3 

Zero Location (La) 

0.5, 1, 1.5 

Short Period Frequency (co) 

0.5, 1, 1.5 Hz 

Damping Ratio (Q 

0.4, 0.7, 1 

Time Delay ( r) 

0, 75, 150 ms 
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Klein and Morelli |g The result was the equivalent of a frequency sweep input, but used many sinusoidal 
components with discrete frequencies applied simultaneously, instead of a single sinusoid with frequency increasing 
monotonically in time. 

Figure 1 shows an example tracking task. The sum-of-sines task was generated as: 
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where u(t) is the pitch attitude tracking command (deg), the discrete frequencies 2nkjT were chosen to span the 
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frequency range of 0.1 to 10 rad/sec, the phase angles ( (j ) k ) were random, and the amplitudes ( A k ) were chosen to 
customize the power spectrum of the multi-sine input. In this application, the phase angles were chosen at random 
to emulate a random sinusoidal input. The frequency indices (£) were chosen at irregular intervals, which also 


helped to emulate a random sinusoidal input. 

2. Subjects 

Four pilots participated as subjects. The 
average age was 50 (standard deviation of 3.6) 
years old. The average years flying was 20.5±12 
and the average number of flight hours was 
3312±4483 hrs. Subject 4 had the least number of 
flight hours (<600 hrs) and years flying (~ 6) 
whereas the next closest subject had about 1000 
flight hours and approximately 15 years of flying 
experience. Subject 8 had the most flight hours 
(>10,000 hrs) and the most years flying (> 30 
years) while the next nearest subject had just under 
2000 flight hours. 

B. Pilot Behavior Representation 

The only assumption made on the structure of 
model of pilot control action is that the model is in 
the linear parameterization form: 

y(t) = Q T <t>(x(t)) + s(t) (3) 

where y(t) e R"‘ ,x(t) e R" are the system output 

and input signals, the (Nxm)-matrix 0 e R Nxm 
contains the unknown parameters to be estimated, 
the regressor matrix ®(x(f)) e R ' represents the 
N-dimensional vector of chosen basis functions 
and s(t) e R"‘ denotes non-parametric uncertainty 
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Figure 1. Longitudinal input signal. 


in the system (such as noise, modeling error, etc.). If cp(x(f)) is chosen to be a Radial Basis Function (RBF), then 

this formulation exploits the Universal Approximation properties of the RBFs covered by the Michelli’s theorem, 

n 

which assures that it is always possible to approximate fix) on a grid of points using f ix) = X 9^{x - x t ) such 


that /(*, ) = /(*, ) for all . 

In many practical applications, the RBFs are Gaussian functions of the form: 

||. t - C ,|| 2 

<t> t (x)=e 2of , (i = l,...,N) 

where cr represents the width and C ( . £ R" is the center of the /th Gaussian function and the regressor vector is 

<Hx) = {it>jx)...<t> N (x)) 1 <=R N . 

In on-line estimation, the non-parametric uncertainty s(t) is omitted and the estimated value 0 = 0(f) is updated 
once a new set of data y(t ) and 4>(x(f)) becomes available. 
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C. Gradient Descent Estimator 21 

Assume that the output of the model (3) is scalar and there are no non-parametric uncertainties in the model; that 
is, s(t ) = 0 and the static linear in parameters model takes the form 

y(t) = 0 T< &(x(t )) . 

Let 9(t) denote the parameter estimation vector at time t. Then the output prediction is of the form 

y{t) = 6 T ®{x(t)). 

The basic idea in the gradient based estimation is to update the estimated parameters 0{t) in such a way that the 
prediction error 

e v =y(t)-y(t ) 

is reduced. The parameter estimation proceeds in the inverse direction of the gradient of the weighted squared 
prediction error with respect to the estimated parameters. The online implementation of the Gradient Estimator 
(GDE) is of the form 

m = -r® wo) (® wof m - y (o) (4) 

where F = T r >0 is a symmetric positive definite matrix called the estimation gain and y(t) = ®(x(0) r <9(0 
represents the predicted/estimated output of the model at time t. A common choice for E is T = yI NxN where y is a 
positive scalar gain. Increasing y leads to faster estimation and prediction but at some point larger size leads to 
oscillatory behavior and slower convergence and increased sensitivity to noise and disturbances. One potential issue 
with GDE is slow convergence; thus, multiple estimation algorithms should be applied to the data. 


D. Least Squares Estimator with Exponential Forgetting 21 

Another approach to estimation is least-squares minimization. In this approach, instead of minimizing 

instantaneous prediction error e = y(t) - y(t ) , a quadratic cost function of the prediction error with respect to 0(t) 

is minimized. This Least-Squares Estimator is characterized by good robustness with respect to noise and 
disturbances, but poor ability in tracking time -varying parameters. The reason for the latter is that the least-squares 
estimate attempts to fit all the data up to the current time while, in reality, the old data is generated by old 
parameters and thus should be discounted when estimating the current parameters. 

Exponential forgetting of data is a very useful technique in dealing with time-varying unknown parameters. 
Hence, instead of penalizing all of the past errors from z=0 to z=t that are due to 0(t) ^ 6 (as it is done when 


deriving the pure Least-Squares Estimator), the minimization problem is posed for the cost function with the so- 


called exponential forgetting factor J3(t, r) = exp 


-J Mr)dr 


. If Mr) = A > 0 is a constant, then J3(t,r) = e 


This data forgetting feature of the Least-Squares Estimator with Exponential Forgetting (LSEEF) results in the 
estimator ability to track slowly vaiying parameters. 

The recursive online implementation of the LSEEF is given by 


0 (t) = -r(0®W0)(®W0) r <9(0-3<0), m = 4 

f (0 = Mt)m -r(t)®(x(t))®(x(t)) r r(t), r( 0 ) = r 0 


Note that LSEEF has the ability to track time-varying parameters but there is a possibility of gain windup in the 
absence of persistency of excitation. The gain windup problem can be overcome by employing the bounded gain 
forgetting technique. In the case presented here, the pilot was constantly involved in the tracking task and gain 
windup never became an issue. However, especially if the pilot is only intermittently involved in hands on the stick, 
bounded gain forgetting modification will become necessary in future tasks. 


III. Results 

The effects of individual subject characteristics and the vehicle dynamics on the ability of GDE and LSEEF to 
estimate Stick Jwt, the estimated position of the stick ( y{t) in the discussion above), are presented below. In this 
case, the preferred outcome of the analyses would be for there to be no differences in the ability of the estimator 
algorithms with respect to the subject and the vehicle dynamics. This would indicate that the accuracy of the 
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estimation methods is not a function of individual subjects or the specific vehicle characteristics; thus, the estimator 
algorithms may have the capability to be applied broadly. 

Additionally, Stick hat was estimated using two different input functions ( x(t) in the discussion above): (1) the 
commanded pitch position, Pitch_cmd and (2) the error between actual vehicle pitch and Pitchcmd (Pitch - 
Pitch_cmd). Obviously, other functions are possible but these two represent basic methods of tracking a driving 
function, pursuit and compensatory. 

Lastly, the ability of the GDE and LSEEF methods to estimate Stick hat using data from a more realistic flight 
maneuver was examined. This data also contained a change in aircraft dynamics due to surface failures and it was 
of interest to briefly investigate how well the algorithms would handle these changes in dynamics. 

A. Effects of Subjects and Vehicle Dynamics on Estimator Methods 

In order to determine if either the GDE or LSEEF methods to calculate Stick hat were affected by the vehicle 
dynamics or individual subject characteristics, an analysis of variance was done with subject and vehicle dynamics 
as the independent variables and the mean of the absolute difference between Sitck and Stickjmt (fj A ) as the 

| 5 -<?| 

dependent variable. Significance set at p<0.05. Analyses indicate that neither subject nor the vehicle dynamics 
statistically significantly affected // A for both the GDE and LSEEF methods for calculating Stickjmt. This 

\s-s\ 

implies that both methods to calculate Stick hat were equally accurate irrespective of the vehicle dynamics over the 
tested ranges listed in Table 1. Furthermore, these methods showed promise in accounting for individual subject 
manual control differences. This suggests that the GDE and LSEEF methods to calculate Stickjmt do not require 
any “tuning” with respect to vehicle dynamics and subject characteristics. 

Statistical significance was also not reached for fu A when Stickjmt was calculated from Pitch cmd or 

\ts-s\ 

Pitch-Pitch _cmd ( e{6 — 0 cmd ) ) although the GDE method was slightly better calculating Stickjmt using Pitch_cmd 
(see Fig. 2). Therefore, the inputs Pitch cmd or e{0 — 0 cmd ) are equally accurate for calculating Stickjmt. 

As mentioned above, subject was not statistically significant for e(d — 0 cmd } when comparing the GDE and 

LSEEF methods. However, looking at the Stick 
tracking errors for both methods by signal input, the 
GDE method was slightly more accurate for subjects 
when the tracking signal was Pitch_cmd (see Fig. 3) 
whereas for the LSEEF method, the accuracy of 
using either Pitch or e{0 — 0 cmd ) was essentially 

equal for all subjects (see Fig. 4). Therefore, it may 
be possible to tease out some piloting characteristic 
differences when using the GDE method to 
estimate/predict Stickjmt. 

B. Stick hat Estimation Differences between 
Estimator Methods 

Not surprisingly, the GDE method is faster than 
the LSEEF method even though the accuracy of 
Stick Jiat for these dynamics and control task were 
basically the same for both methods (see above). 

The typical time to calculate a 32 sec run for the 
GDE method was around a second and the typical 
time for the LSEEF method was just under 6 
seconds. 

An example of the accuracy of the GDE method 
to calculate Stickjmt from Pitch_cmd and 
e(O-0 cmd ) is shown in Figure 5. For that subject’s 

run, // A when using Pitch_cmd was 0.068 (3.4% 

!<'• <>' 
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Residual (Stick_hat - stick) stick Throw ([-i:i]) Mean Absolute Residual 


of total possible stick throw) and 0.050 (2.5% of total possible stick throw) when using e{6 — 6 cmd ) . 
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( Pitchcmd or e(0 - 0 imd ) ) and Subject for the 
GDE method. 


Subject 

Figure 4. /j A as a function of Input Signal 

{Pitch cmd or e(0- 0 imd ) ) and Subject for the 
LSEEF method. 
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Figure 5. Stick and Stick hat with Pitch cmd and e(0 — 0 cmd ) and their associated residuals as the input for 


the GDE method for a particular subject’s run. 

6 

American Institute of Aeronautics and Astronautics 


An example of the accuracy of the LSEEF method to calculate Stick _hat from Pitchcmd and e(0 — 0 cmd ) is 

shown in Figure 6. For that subject’s ran, ju A when using Pitch_cmd was 0.11 (5.6% of total possible stick 

\s-s\ 

throw) and 0.09 (4.5% of total possible stick throw) when using e{0 — 0 cmi ) . 




Figure 6. Stick and Stickhat with Pitch cmd and e(0 - 0 rmd ) and their associated residuals as the input for 


the LSEEF method for a particular’s subject run. 


C. Detecting Changing Vehicle Dynamics 

Because both the GDE and LSEEF methods to estimate Stick Jicit were successful, data from another experiment 
that involved changing vehicle dynamics were used to see if Stick _hat could be successfully estimated and to 
investigate the effects of the changing dynamics on the accuracy of Stick hat. This experiment involved having 
subjects again follow the flight director for 90 sec at cruise altitude and speed during either a 2000 ft/min climb or 
descent, or during a heading change. During this time, the vehicle dynamics changed from nominal because of stuck 
control surfaces. The control system used by this experiment was an L\ adaptive control system that would either 
adapt immediately, in 3 sec, in 7 sec, or never. The GDE method was used to analyze the longitudinal data because 
of the computation times and possible gain windup discussed above. 

For a subject’s ability to track longitudinally, the GDE method was able to successfully estimate Stick hat using 
both the Pitch and e{0 — 0 cmd ) input signals (see Figs. 7 and 8). The change in dynamics is visible when analyzing 
jtl A . When the adaptive controller does not compensate for the surface failures, jU A when using Pitch as the 

|<5-5| |5-5| 

input from a particular subject’s run went from 0.006 before the failure to 0.012 after the failure (see Table 2 and 

Fig. 7). When using e(0 — 0 cmd ) as the input, fj A for a particular subject’s run went from 0.009 before the 

\s-s\ 

failure to 0.034 after the failure. When the adaptive controller immediately compensated for the stuck surfaces, the 
average absolute error before the failure, during the failure + 3 sec, and after the failure + 3 sec were essentially the 

same (see Table 2 and Fig. 8) for a particular subject’s jU A but e(0 — 0 . ) did show an increase during the 

\s-s\ 

failure + 3 sec. The 3 sec were added in order to account for the time it typically takes a human to adapt to changing 
dynamics 22 23 . As when the adaptive controller adapted immediately, when the adaptation time was 3 or 7 sec, the 
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Table 2. Effects of changing aircraft dynamics on calculating Stick hat for a particular subject’s run. 


Failure 

Onset 

Time 

(sec) 

Adaptation 
Time (sec) 

// A for Pitch cmd 

\s-s\ 

fj A for e(9-0 cmd ) 

\s-s\ 

Before 

Failure 

During 

Failure 

After 

Adaptation 

Before 

Failure 

During 

Failure 

After 

Adaptation 

12 

Never 

0.006 

0.012 


0.009 

0.034 


9 

3 

0.001 

0.002 

0.001 

0.001 

0.006 

0.002 

21 

7 

0.004 

0.006 

0.006 

0.012 

0.024 

0.018 

22 

Immediate 

0.005 

0.005 

0.007 

0.006 

0.013 

0.007 




the GDE method with changing aircraft dynamics and no adaptation for a particular subject’s run. 

e\9 — 9 cmd ) input was more sensitive to the subject’s adapting to the failure and then to the changes the adaptive 
controller implemented. As can be seen in Table 2 for a particular subject’s e(d — Q ctni ), the “during adaptation 

after the failure” // A was approximately double the amount as it was both “before failure” and “after adaptation,” 

\s-s\ 

which included adaptation by both the aircraft control system and the subject. 

The apparent ability of e(0 — in the GDE method to accurately estimate stick position during typical 

cruise flight maneuvers is promising for possibly detecting changes in pilot behavior, whether these changes are due 
to changing aircraft dynamics or due to effects on the pilot such as high workload, situation awareness, fatigue, etc. 

IV. Discussion 

The purpose of the research described above was to go beyond pilot identification based on collected 
experimental data and to develop a predictor of pilot behavior. An experiment was conducted to quantify the effects 
of changing aircraft dynamics on an operator’s ability to track a signal in order to eventually model a pilot adapting 
to changing aircraft dynamics. GDE and LSEEF algorithms used these data to predict pilot stick input. 

The results indicate that individual pilot characteristics did not affect the accuracy of the GDE and LSEEF 
methods to estimate pilot stick input. Therefore, minimal tuning with regards to the pilot will be needed when trying 
to predict Stick_hat with either methods. Furthermore, the vehicle dynamics also did not affect the accuracy of the 
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Figure 8. Stick and Stickhat with Pitchcmd and e(0 — 0 cmd ) and their associated residuals as the input for 
the GDE method with changing aircraft dynamics and immediate adaptation for a particular subject’s run. 


two methods to estimate pilot stick input. This again suggests that the methods may not require significant tuning to 
individual aircraft dynamics. 

The methods may also be able to handle changing dynamics; in fact, this was the case. Using driving functions 
that incorporated changing aircraft dynamics, the GDE was able to accurately estimate pilot stick input before, 
during, and after a control surface failure that affected the dynamics of the aircraft. In fact, the GDE method was 
able to accomplish this during basic cruise flight maneuvers that did not entail a great deal of dynamic input by the 
subject during a manual flight condition. The GDE method may also have the capability to detect a change in the 
subject’s input when looking at the error between the commanded pitch attitude and the vehicle’s actual pitch 
attitude. While the subject appeared to be adapting to the changed aircraft dynamics, this error increased before it 
settled back down to pre-failure error levels. 

Both the GDE and LSEEF methods were equally able to predict the subject’s input. However, looking at the 
stick tracking errors for both methods by signal input, the GDE method was slightly more accurate for subjects when 
the tracking signal was Pitch cmd. Therefore, it may be possible to differentiate changes in piloting characteristics 
due to workload, situation awareness, engagement, etc., when using the GDE method to calculate Stick hat. 

V. Conclusion 

Although these results are just starting to quantify the abilities of estimator methods to predict pilot stick input, 
the above results do hint at some capabilities. These capabilities include a minimal need to optimize the algorithms 
to pilot characteristics or vehicle dynamics, an ability to detect changes in either vehicle dynamics or the state of the 
pilot, and the capability to predict pilot stick input in real time. The ability of the algorithms to work in real time 
and their accuracy in predicting pilot stick input may be affected during maneuvers in both longitudinal and lateral 
directions. Lastly, other input functions may even predict pilot stick input better or detect changes in the pilot or the 
vehicle. 
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